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(57) ABSTRACT 

A method and image processing system are disclosed which 
simulate a hair style selected from among a number of 
prestored hair images in association with a facial image. The 
selected hair image includes an interior perimeter to be 
positioned adjacent to the facial image and a first plurality of 
associated feature points distributed along the interior 
perimeter of the hair image. A subset of the first plurality of 
feature points are disposed at locations at which the hair 
image is intended to abut, but not substantially overlap the 
facial image. The size and orientation of the selected hair 
image are automatically corrected with respect to the facial 
image. A second plurality of feature points distributed along 
the facial perimeter are then determined, which each corre- 
spond to one of the subset of feature points. One or more 
facial perimeter vectors are constructed by connecting 
neighboring feature points within the second plurality of 
feature points. Similarly, one or more hair perimeter vectors!) 
are constructed by connecting neighboring feature points] 
within the subset of feature points. The hair image JsJ 
automatically transformed by displaying each of a plurality ( 
of pixels within the hair image at a transformed location with * 
respect to the facial perimeter vectors determined from an 
original position of the pixel with respect to the hair perim- 
eter vectors. In response to the transformation of the hair" 
image, the transformed hair image is displayed superim- 
posed on the facial image. 

24 Claims, 8 Drawing Sheets 
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AUTOMATED METHOD AND IMAGE 
PROCESSING SYSTEM FOR HAIR STYLE 
SIMULATION 

BACKGROUND OF THE INVENTION 

1. Technical Field 

The present invention relates in general to a method and 
system for image processing and in particular to a method 
and system for simulating hair styles. Still more particularly, 
the present invention relates to a method and system for 
automatically fitting a hair image selected by a user to a 
facial image of the user. 

2. Description of the Related Art 

Usually, when people desire to get their hair styled, they 
specify a hair style at a hair salon or other beauty facility and 
request that a hair stylist to cut their hair in the desired style. 
However, some people want to verify whether various hair 
styles complement their facial features before the hair stylist 
starts to cut their hair. In such cases, a simulation of various 
hair styles is helpful. 

Although a simulation system for hair styles is currently 
available, a user is required to manipulate the simulation 
system to fit various predetermined hair style images to an 
image of the customer's face. That is, an image of the 
customer's face and various hair styles are fitted to each 
other in accordance with the following steps: First, using 
photo retouch software, the user manually scales, rotates, 
and translates a hair image to align the hair image with an 
image of the customer's face. Then, utilizing a painting tool, 
the user finishes the simulation by filling in gaps around the 
face or neck and deleting hairs that overlap with the facial 
image. One example of fitting hair images to a facial image 
utilizing this manual operation is found in Japanese PUPA 
62-161308. 

Although the manual method for fitting hair images to 
facial images provides satisfactory results, particularly in the 
finishing of images, the time required to align and finish an 
image is between 20 and 30 minutes and is therefore 
inappropriate in view of the typical waiting time in a beauty 
shop. In practice, assuming that the waiting time in a beauty 
shop is about 10 minutes and that several hair styles may be 
simulated, the hair imaging simulation must be finished in 
about one minute per hair style. Thus, it should be apparent 
that even one hair style cannot be simulated by conventional 
hair style simulation systems during a typical waiting time 
in a beauty shop. Furthermore, the manual operations 
required in a conventional simulation system entail compli- 
cated manipulations of images and may therefore be difficult 
for some users to perform. 

Another hair style simulation system is disclosed in 
Japanese PUPA 5-189542. In this simulation system a hair 
image is obtained by creating a 3-dimensional model of a 
hair style, performing a modification operation that accounts 
for the effects of external forces, such as wind and gravity, 
and finally rendering a picture of the hair style. However, 
this simulation system is ineffective due to the data volume 
required for modeling the hair style, the processing time 
required, and the lack of realism in the resulting images. 

Consequently, it would be desirable to provide an 
improved method and system for simulating hair styles 
which automatically fit an image of a selected hair style to 
a facial image. 

SUMMARY OF THE INVENTION 

It is therefore one object of the present invention to 
provide an improved method and system for image process- 
ing. 
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It is another object of the present invention to provide an 
efficient method and system for simulating hair styles. 

It is yet another object of the present invention to provide 
an easily operable hair style simulation system which auto- 

5 matically fits an 

The foregoing objects are achieved as is now described. 
A method and image processing system are disclosed which 
simulate a hair style selected from among a number of 
prestored hair images in association with a facial image. The 

10 selected hair image includes an interior perimeter to be 
positioned adjacent to the facial image and a first plurality of 
associated feature points distributed along the interior 
perimeter of the hair image. A subset of the first plurality of 
feature points are disposed at locations at which the hair 

15 image is intended to abut, but not substantially overlap the 
facial image. The size and orientation of the selected hair 
image are automatically corrected with respect to the facial 
image. A second plurality of feature points distributed along 
the facial perimeter are then determined, which each corre- 

20 spond to one of the subset of feature points. One or more 
facial perimeter vectors are constructed by connecting 
neighboring feature points within the second plurality of 
feature points. Similarly, one or more hair perimeter vectors 
are constructed by connecting neighboring feature points 

25 within the subset of feature points. The hair image is 
automatically transformed by displaying each of a plurality 
of pixels within the hair image at a transformed location with 
respect to the facial perimeter vectors determined from an 
original position of the pixel with respect to the hair perim- 

30 eter vectors. In response to the transformation of the hair 
image, the transformed hair image is displayed superim- 
posed on the facial image. 

The above as well as additional objects, features, and 

35 advantages of the present invention will become apparent in 
the following detailed written description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the invention 
40 are set forth in the appended claims. The invention itself 
however, as well as a preferred mode of use, further objects 
and advantages thereof, will best be understood by reference 
to the following detailed description of an illustrative 
embodiment when read in conjunction with the accompa- 
45 nying drawings, wherein: 

FIG. 1 is a block diagram illustrating a preferred embodi- 
ment of the configuration of the system of the present 
invention; 

FIG. 2 is a high-level flowchart depicting a preferred 
50 embodiment of the method of the present invention; 

FIG. 3 illustrates points within a facial image which 
comprise facial information in a preferred embodiment of 
the present invention; 

FIG. 4 depicts feature points within a hair image; 
55 FIG. 5 illustrates the method utilized by the present 
invention to compute facial width; 

FIG. 6 depicts the method utilized by the present inven- 
tion to correct the slant of a hair image; 
60 FIG. 7 illustrates the method utilized by the present 
invention to correct the position of a hair image; 

FIGS. 8 A and 8B depict the transformation of an image 
pixel with respect to a single reference vector according to 
the present invention; 
65 FIGS. 9A and 9B illustrate the transformation of an image 
pixel with respect to a plurality of reference vectors accord- 
ing to the present invention; 
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FIG. 10 is a flowchart of the process utilized by a does not overlap with the face region of the facial image, 

preferred embodiment of the present invention to transform Finally, at block 40, the corrected hair image is superim- 

pixels within an image with respect to a plurality of refer- posed on the facial image by the graphic subsystem 24 and 

ence vectors; the superposed image is displayed within display device 26. 

FIG. 11 illustrates the computation of the distance 5 The process summarized in FIG. 2 will be described in 

between a reference vector and a pixel outside of the extent greater detail below. 

of the reference vector according to the present invention; Photographing Facial Images and Extracting Facial 

FIG. 12 depicts the translation of facial feature points Information 

according to the present invention; and ^ Fadal obtaincd ^ ^mcn 2, which may be still 

FIGS. 13A and 13B depict the adaptive division of a images, are converted into a format suitable for handling by 

reference vector according to the present invention. processing unit 10. Because the results achieved utilizing 

various types of facial image formats are usually similar to 
those resulting from still images, the image formats will not 
15 be further described here. For best results, the facial image 

With reference now to the figures and in particular with is taken from the front with the user's hair up in order to 

reference to FIG. 1, a preferred embodiment of the configu- expose the user's forehead and to prevent hair from obscur- 

ration of the hair style simulation system of the present ing the user's face. 

invention will be described. A user desirous of performing a With reference now to FIG. 3, there is illustrated a 

hair style simulation takes a picture of his or her own face 2 o diagram of facial features utilized to ascertain facial infor- 

utilizing a camera 2. Camera 2 is connected to a facial mation. As shown in FIG. 3, facial information extracted 

information storage 6, which temporarily stores photo- from a facial image includes both eye tails (point LE and 

graphed facial images. Camera 2 is further connected to point RE), the underpart of a nose (point UN), the head top 

facial information extraction device 4, which extracts facial (point HI), the jaw (point JP), the face region (area FR), and 

information from a facial image. Facial information extrac- 25 the head region (area HR). These positions and regional 

tion device 4 is also connected to facial information storage information are automatically extracted by image processing 

6 in order to store extracted facial information. Hair style by facial information extraction device 4. Because the 

simulation system 1 includes hair information storage 8 for positions and regional information are the same as those 

storing hair images to be selected by users and hair infor- ordinarily used by hair simulation systems and do not 

mation to be used for transforming the hair images. Hair 30 constitute a central feature of the present invention, the 

information storage 8 and facial information storage 6 are positions and regional information will not be described 

both connected to processing unit 10. further. - — 

Processing wit 10 comprises a hair image correctioa Selection of a Hair Style to be Simulated 
section 12, which corrects the size, slant, and position of a 

selected hair image retrieved from hair information storage 35 Prior t0 ^^g hair images, hair images must be stored 

8, and a hair image transformation section 14, which trans- m thc hair ^formation storage 8. As with facial images, 

forms the hair image (and hair information) into an appro- mese hair are photographed utilizing camera 2. As 

priate shape after the processing of hair image correction shown m nG 4 > however, it is necessary to cut out the hair 

section 12. Processing unit 10 is connected to an input/ ™& on 42 and t0 P^ni the background 45 wholly in a 

output (I/O) unit 22, which includes an input device for 40 C0DlrastiD g color ( blue m a preferred embodiment). In 

receiving input for the selection and processing of hair addition, it is necessary to photograph the hair image from 

images and a printer for printing the results of a hair style me fr° nt - 

simulation. A graphic subsystem 24 and a display device 26 To facilitate subsequent processing, hair information is 

for displaying the final result of a hair style simulation are also prestored. This hair information is expressed as a 

also connected to processing unit 10. 45 combination of positional data of feature points 44 and their 

Referring now to FIG. 2, there is depicted a flowchart of attributes. Feature points 44 are disposed on the oudine of 

a preferred embodiment of the method employed by the hair re g lon 42 of a hau UDa g e at P omts of g reatl y changing 

present invention to simulate a hair style. As illustrated, the curvature and may be relatively few in number in order to 

process begins at block 30 and thereafter proceeds to block reduce computation required to simulate a hair style. The 

32, which illustrates facial images photographed by camera 50 shortcomings attributable to the disposition of the feature 

2 being stored within facial information storage 6 and being P oints *** corrected by later processing steps, 

transmitted to facial information extraction device 4 for the The attribute associated with a feature point 44 signifies 

extraction of facial information, like the facial image, the mat tDe feature point 44 is either a point on the edge of the 

facial information extracted by facial information extraction fac e region that should not overlap with the facial region of 

device 4 is stored within facial information storage 6. Next, 55 a fac ial image (an E point illustrated as a square), a point that 

at block 34, hair images or the names of hair styles are can overlap with the face region of a face image (an F point 

displayed to the user within display device 26. The user illustrated as with an X), or an O point (illustrated as •) on 

selects from among the displayed names of hair styles or hair me exterior of hair region 42 that does not border the facial 

images utilizing I/O device 22. Following the selection of a re g ion of a k^al image. These location attributes are 

hair style, hair image correction section 12 of processing 60 assigned predetermined values for use in later processing, 

unit 10 corrects the size, slant, and position of the selected Furthermore, facial information includes corresponding 

hair image with reference to facial information and hair feature points on the original face of a facial image. By 

information, as depicted at block 36. The process then reference to these feature points, a later correction of the 

proceeds to block 38, which illustrates hair image transfer- size, slant, and position of the selected hair image is per- 

mation section 14 transforming the portions of the selected 65 formed. 

hair image intended to overlap regions of the facial image By retrieving hair images from hair information storage 8 

and processing the portions of the selected hair image that and presenting them to a user, a user is enabled to select a 



09/02/2004, EAST Version: 1.4.1 



US 6,453,052 Bl 

5 6 

particular hair image to simulate. Hair images may be positional relation, of (U, V) relative to the transformed 

displayed in a window format or simply in a screen divided reference vector P f Q\ By substituting a pixel value of X 1 far 

into display areas. Alternatively, the display may be the pixel value of X, the transformation is complete. 

arranged to list names of hair images, display only names of With reference now to FIGS. 9A and 9B, there is illus- 

hair images, or display a selected hair image alone within 5 trated a pictorial representation of tbe transformation of a 

display device 26. In response to a user's selection of one of pixel X with respect to a plurality of reference vectors. When 

the displayed hair images, subsequent processing is initiated. there are a plurality of reference vectors, the dependency of 

r r-t* rt f H a * 1 PC eacn P**^ on individual reference vectors PfQ.is computed 

a r f and ue transformed pixel is translated in accordance with 

r ?^,k a! r r . f * , • A < u rt each dependency. That is, as shown in FIG. 9A, the posi- 

First, the width WF of a face in a facial image and the 10 ^ , y *• J- c * ~* n r\ a n n, -*u 

•j.u «tit fL • • i_ - * 1 > , r - , Uonal relationship of reference vectors P,Qi and P 2 Q 2 with 

width WH of hair m a hair image are evaluated. The facial ^ tQ ^ ^ ^ ^ b ^ y y fa* y2) 

width is evaluated by calculating the respective distance res ^ ctively i . However, application of these relationships to 

from each point on the outline of a face to the line VL ^ transformed reference vectors often does not result in a 

connecting the head top point HT and the jaw JP, as shown singlc X 'as shown in FIG. 9B. Thus, a point X 1 is 

in FIG. 5, and determining the maximum values in the right 15 computed for each individual reference vector. Thereafter, as 

half and left half of the facial image. The sum of both shown in FIG. 9B, a single pixel X" is computed from the 

maximum values is the width of the face. If the size of a hair points X* obtained from each reference vector P,Q, on the 

image is corrected, it is advisable to compute a value of basis of the distance between pixel X and the transformed 

WF/WH and enlarge the length and width of a bair image by and reference vectors so that a reference vector closer to 

WF/WH. However, if the size of a face image is corrected, 20 pixel X affects the transformation more, 

it is advisable to compute a value of WH/WF and enlarge the Referring now to FIG. 10, there is depicted the procedure 

length and width of a face image by WH/WF. In the for transforming each pixel in an image with respect to a 

described embodiment, only the hair image is corrected. plurality of reference vectors. First, the variables for a 

B. Correcting the Slant particular pixel are initialized to 0 as illustrated at block 50. 
Next, a slant angle of the head & (rotation angle around 25 Next, as depicted at block 52, the transformation variables 

an axis perpendicular to the image) of the facial image and (U, V) are computed for every reference vector. The process 

hair image is determined. As shown in FIG. 6, this angle is then proceeds to block 54, which illustrates determining the 

evaluated from the slant of a line connecting both eye tails position of X' by applying (U, V) to the corresponding 

LE and RE (0-0 along the vertical axis connecting HT and reference vector P/Q/. The process proceeds from block 54 

JP). To correct the slant, either the hair image or the facial 30 to block 56, which depicts computing the shortest distance 

image is rotated by the difference angle ©. (Dm**) &° m x to P A- x usually lies within the range 

C. Correcting the Position of vector PQ as shown in FIG. 8A. However, when X lies 
First, a reference point W for positional correction is outside the range of vector PQ as shown in FIG. 11, it should 

determined. As shown in FIG. 7, this reference point W is be noted that XP becomes the shortest distance determined 

the center of gravity of a triangle ABC connecting eye tails 35 at block 56. 

LE and RE and the point UN directly below the nose. As is Next, a weighting value is computed at block 58 by the 

described below, the hair image is translated based upon a formula: weight-(length7a+D,„ £ J i ', where length means the 

positional difference between points within the hair image length of reference vector Pfl,, V min signifies the shortest 

and W. However, a face image may alternatively be trans- distance from X to P/},-, and a, b, c are appropriate constants, 

lated. 40 Although this formula may be utilized, a preferred embodi- 

When a hair image corrected in size, slant, and position is ment of the present invention simply assigns a preset weight 

simply pasted onto a facial image, a gap is often apparent to each reference vector instead of using the c-th power of 

around the face or neck, or hair overhangs a portion of the the length. The preset weights are set by reference to 

cheek too much. To eliminate these problems, the hair image attributes assigned to feature points forming the base of the 

is transformed by the following method to fit with the facial 45 reference vector. That is, if the attribute of a feature point is 

image. an E point, the feature point is HEAVY. If the attribute is F, 

The image morphing transformation is performed by the feature point is HEAVY if the feature point is translated 

transforming a pixel with respect to transformed reference or else LIGHT. If the attribute is O, the feature point is 

vectors disposed on the image. That is, a pixel in the hair LIGHT. More particularly, weights are set to 4.0 for HEAVY 

region of a hair image is drawn by substituting a pixel value 50 and 1.0 for LIGHT, while "a" and "b" are set to 0.5 and 2.0, 

computed by reference to the transformation of a reference respectively. 

vector for the original pixel value of the point. Weights determined at block 58 are then utilized to 

Specifically, the image morphing transformation for a calculate accumulated values at blocks 60 and 62. After each 

pixel with respect to a single reference vector is accom- reference vector is processed, X is transformed utilizing the 

plished as illustrated in FIGS. 8A and 8B. As depicted FIG. 55 saved weights to determine an appropriate X* (block 64) and 

8A, the positional relation between the pixel X and a the pixel value of X' is substituted for the pixel value of X 

reference vector PQ is represented with a pair of variables (block 66). 

(U, V). U is expressed as a ratio of the distance between the 1* Translation of Feature Points 

intersection point S of the perpendicular dropped from X to The deformation operation of a hair image determines 

PQ and P, relative to the size of PQ. Thus, a value of U 60 how the hair image and facial image overlap with each other 

ranges from 0 to 1 as S moves from P to Q. V is also and translates feature points of the hair image to fit with the 

expressed as a ratio between the length of the perpendicular facial image. Tests of overlap are as follows: 

from X to PQ and the length of PQ. Because they do not overlap the face, the feature points 

Referring now to FIG. 8B, there is depicted a transfer- having attribute O (not contacting the face region) are 

mation of pixel X to pixel X*. As depicted, pixel X, repre- 65 not tested. 

sented by transformation variables (U, V) as is shown in When a feature point Pf having an attribute F is situated 

FIG. 8A, is transformed to pixel X', which satisfies the outside of the face region FR of the facial image as shown 
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in FIG. 12, the intersection point Pf between the .face-region 1. The portion of the hair region. HR within the facial 

and the line connecting the point Pf with the reference point image is deleted and filled with the background color. This 

W of the face is determined. Pf is then translated to Pf . prevents the hair region of the facial image from protruding 

However, if the point Pf is situated within the face region, no from beneath the synthesized hair image, 

translation is performed. 5 2. The portions other than the background pixels (here, 

With respect to the feature point Pe having attribute E as Wue ^ are extracted ^ me haif re ^ Qn from a deformed 

shown m FIG. 12, a line isdrawn trough , point Pe in parallel haif ^ ' (L processing). The values stored 

with the line connecting eye tads RE and LE. The mtersec- £ \ ^ J* ^ ^ ^ 

Uon point Pe* of this line with the facial region is then , v e ^. 4 f c *i_ 

determined to translate point Pe to the point Pe'. That is, ( 0 P^ UC ) for a P ortlon of biur ^ 0 (transparent) for other 

point Pe is translated such that Pe' is situated on the border portions. 

of the face region. 3- A smoothing filter is then applied on an a value of the 

2. Generation of Reference Vector edge portion of the hair region. A smoothing filter, such as 
Utilizing the methodology described above, the feature a 5x5 Gaussian filter, is contemplated, but other appropriate. 

points having attributes E and F are individually translated, filters can also be implemented. 

thereby generating feature points of each type on the outline 15 4. Using a value of the a buffer, a -blend the hair image and 

of the hair image and the facial image. Thus, for each of the facial image 

feature ^point attributes E and F reference vectors are con- 5 Dis ^ the a . blended on ^ y dev ice 28 of 

structed for the hair image and the facial image by connect- j 

ing adjacent feature points having the same attribute. n't r • * *u • 1 ** c 

3. image Morphing Transformation 20 fc ^Pf^enUng the foregoing steps, the simulation of a 
Relative to reference vectors generated in this way, the hair is accomplished; however, the present invention is 

image morphing transformation described above is per- not lunited t0 the embodiment described above. For 

formed. However, prior to translation, the adaptive division example, the above description states that a face image is 

described below is performed relative to a reference vector photographed prior to the selection of a hair image, but 

related to the E feature point attribute. 25 performing these steps in inverse sequence poses no prob- 

4. Adaptive Division of Reference Vectors lem. The points which may be selected as facial information 
Hie computation required by an image morphing trans- are not limited to the particular points utilized in the 

formation depends to a large extent upon the size of an described embodiment, and other points may be specified, if 
image and the number of reference vectors. In fitting a hair appropriate. Furthermore, the formulas and constants uti- 
image to a facial image, the utilization of a larger number of 3Q Uzed to compute the weights in the image morphing trans- 
reference vectors improves the positional alignment of the formation of a point with respect to a plurality of reference 
hair image and results in a smoother synthesis. However, an vectors can be replaced with other weights and constants if 
increase in the amount of computation required to perform appropriate. In addition, the basis for performing an adaptive 
the simulation defeats one of the purposes of the present division was the maximum distance between the reference 
invention-to decrease the simulation processing time. yector and the facial rc ^ on ^widaiy, but may be estab- 
llnis as mentioned above, the selected feature points are not * Hshcd by ^ ^ circumscribcd by me reference vector and 
closely spaced the boundary of the facial region. 

However, if a reference vector connecting the feature „«.«,. 7 • , , 

points P and Q is constructed as shown in FIG. 13A, the , WWe the invention has been particularly shown and 

region L is formed between the reference vector PQ and the described with reference to a preferred embodiment, it will 

outline of the face region. Although the attribute of feature 40 be understood by those skilled in the art that various changes 

points P and Q is E, region L is a portion of the simulated m form and detail may be made therein without departing 

image in which the hair region and the face region overlap fro™ the spirit and scope of the invention, 

each other. Consequently, a new feature point should be What is claimed is: 

added between feature points P and Q. Under these 1. A method within a image processing system for simu- 

circumstances, an adaptive division of the reference vector 4S lating a selected hair style, said image processing system 

is performed. including a display apparatus and storage media for storing 

With reference now to FIG. 13B, there is illustrated an one or more hair images, said method comprising the steps 

example of an adaptive division of a reference vector to Q f: 

determine a new feature point. This adaptive division is providing a facial image, wherein said facial image 

performed when the value of overlap error of a facial image indudes a faciaJ re ^ on bmaM b a fadal rimeter; 

(i.e., the largest distance between the outline of the face , . ~ . , , . . . . . 

region and the reference vector) computed after the genera- " etoau « one ° f «"» ° ne or , mo ? ^ ,mageS 

tion of a reference vector exceeds a predetermined value, f 0 ^ media t0 te . samu ! ated m ■~ a f t>M1 ™ th , 

and is continued until the value of the overlap error becomes ™«8* ^ herelD selec . ted T* 8 ' 

lower than a predetermined value. The adaptive division is f . m 1 tenor Penmeter to be positioned adjacent to said 

accomplished by establishing a new feature point S' at a * facial image, said interior perimeter of said selected 

point on the outline of the hair region nearest to the midpoint ha,r ma & e including » first plurality of feature points 

of the reference vector PQ' and translating S' onto the distributed along said interior perimeter of said hair 

outline of the face region. Reference vectors are then created ""W wherein a of first P lurahtv of Eeature 

as described above. If the overlap error becomes less than P 0 "" 5 m ^P 05 ^ •« locatlons 11 wm = h sald b ™ 

the predetermined value, an image morphing transformation « ""S? 15 UJtended 10 abut > but not substantially overlap 

is then performed. said faaal image; 

determining a second plurality of feature points within 

Synthesis and Display of Hair Images and Face ^jd facial perimeter and distributed along said facial 

Images perimeter, wherein each of said second plurality of 

In overlapping a hair image and facial image, processing 65 feature points corresponds to a respective one of said 

using an a buffer is performed to prevent aliasing. The subset of said first plurality of feature points distributed 

procedure is as follows: along said interior perimeter of said hair image; 
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constructing one or more .facial perimeter vectors by 
connecting neighboring feature points among said sec- 
ond plurality of feature points distributed along said 
facial perimeter; 

constructing one or more hair perimeter vectors by con- 5 
nectiog neighboring feature points within said subset of 
said first plurality of feature points distributed along 
said interior perimeter of said hair image; 

automatically transforming said hair image by displaying 
each of a plurality of pixels within said hair image at a 10 
transformed location, wherein a transformed location 
of each of said plurality of pixels within said hair image 
has a position with respect to said one or more . facial 
perimeter vectors determined from an original position 
of said pixel with respect to said one or more hair 15 
perimeter vectors; and 

in response to said transformation of said hair image, 
displaying said transformed hair image superimposed 
on said facial image within said display apparatus, 2Q 
wherein hair style simulation efficiency is enhanced. 

2. The method for simulating a selected hair style of claim 

1, wherein said first plurality of feature points further 
includes a second subset of feature points at locations at 
which said hair image is intended to overlap said facial 25 
image, said method further comprising: 

in response to an existence of a gap between said hair 
image and said facial image at locations at which said 
hair image is intended to overlap said facial image, 

determining a third plurality of feature points within said 30 
facial perimeter and distributed along said facial 
perimeter, wherein each of said third plurality of fea- 
ture points corresponds to a respective one of said 
second subset of said first plurality of feature points 
distributed along said interior perimeter of said hair 35 
image; 

constructing one or more secondary facial perimeter vec- 
tors by connecting neighboring feature points among 
said third plurality of feature points distributed along 
said facial perimeter; 40 

constructing one or more secondary hair perimeter vectors 
by connecting neighboring feature points within said 
second subset of said plurality of feature points dis- 
tributed along said interior perimeter of said hair 
image; 

automatically transforming said hair image by displaying 
each of a plurality of pixels within said hair image at a 
transformed location, wherein a transformed location 
of each of said plurality of pixels within said hair image 5Q 
has a position with respect to said one or more sec- 
ondary facial perimeter vectors determined from an 
original position of said pixel with respect to said one 
or more secondary hair perimeter vectors; and 

in response to said transformation of said hair image, 55 
displaying said transformed hair image superimposed 
on said facial image within said display apparatus. 

3. The method for simulating a selected hair style of claim 

2, wherein said step of determining a third plurality of 
feature points distributed along said facial perimeter com- 60 
prises translating feature points within said second subset 
from said hair image to said facial perimeter by reference to 

a reference point within said facial image. 

4. The method for simulating a selected hair style of claim 

1, and further comprising the steps of: 65 
following the construction of said one or more facial 
perimeter vectors, determining whether a maximum 



45 



distance in an. orthogonal direction from a particular 
facial perimeter vector to a corresponding portion of 
said facial perimeter bounded by neighboring feature 
points utilized to construct said particular facial perim- 
eter vector exceeds a predetermined value; 
in response to a determination that said maximum dis- 
tance exceeds said predetermined value, establishing a 
new feature point on said facial perimeter between said 
neighboring feature points and a corresponding new 
feature point on said interior perimeter of said hair 
image; and 

repeating said steps of determining whether a distance 
exceeds a predetermined value and establishing a new 
feature point for each of said one or more facial 
perimeter vectors. 

5. The method for simulating a selected hair style of claim 
1, wherein said step of transforming said hair image com- 
prises the steps of: 

for each of said plurality of pixels within said hair image, 
computing an intermediate transformed location with 
respect to each of said one or more hair perimeter 
vectors, wherein said intermediate transformed loca- 
tion has an identical position with respect to an asso- 
ciated facial perimeter vector as a position of a pixel of 
said hair image with respect to a hair perimeter vector 
corresponding to said associated facial perimeter vec- 
tor; and 

computing from said one or more intermediate trans- 
formed locations a single transformed location for each 
of said plurality of pixels within said hair image, 
wherein each of said intermediate transformed loca- 
tions is assigned a weighting factor in said computa- 
tion. 

6. The method for simulating a selected hair style of claim 
5, wherein said weighting factor for each of said one or more 
intermediate transformed locations depends upon a distance 
between said pixel of said hair image and said hair perimeter 
vector corresponding to said associated facial perimeter 
vector. 

7. The method for simulating a selected hair style of claim 
1, said facial image including two eyes, wherein said step of 
determining a second plurality of feature points distributed 
along said facial perimeter comprises translating feature 
points within said subset from said hair image to said facial 
perimeter by reference to a reference line intersecting both 
eyes of said facial image. 

8. The method of claim 1, and further comprising the step 
of automatically correcting a size and orientation of said 
selected hair image with respect to said facial image. 

9. An image processing system for simulating a selected 
hair style, said; image processing system including a display 
apparatus and storage media for storing one or more hair 
images, said image processing system comprising: 

means for providing a facial image, wherein said facial 
image includes a facial region bounded by a facial 
perimeter; 

means for selecting one of said one or more hair images 
within said storage media to be simulated in association 
with said facial image, wherein said selected hair image 
includes an interior perimeter to be positioned adjacent 
to said facial image, said interior perimeter of said 
selected hair image including a first plurality of feature 
points distributed along said interior perimeter of said 
hair image, wherein a subset of said first plurality of 
feature points are disposed at locations at which said 
hair image is intended to abut, but not substantially 
overlap said facial image; 
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means for determining a second plurality of feature points . . 
within said facial perimeter and distributed along said 
facial perimeter, wherein each of said second plurality 
of feature points corresponds to a respective one of said 
subset of said first plurality of feature points distributed 5 
along said interior perimeter of said hair image; 

means for constructing one or more facial perimeter 
vectors by connecting neighboring feature points 
among said second plurality of feature points distrib- 
uted along said facial perimeter; 10 

means for constructing one or more hair perimeter vectors 
by connecting neighboring feature points within said 
subset of said first plurality of feature points distributed 
along said interior perimeter of said hair image; 

means for automatically transforming said hair image by 15 
displaying each of a plurality of pixels within said hair 
image at a transformed location, wherein a transformed 
location of each of said plurality of pixels within said 
hair image has a position with respect to said one or 
more facial perimeter vectors determined from an origi- 
nal position of said pixel with respect to said one or 
more hair perimeter vectors; and 

means, responsive to said transformation of said hair 
image, for displaying said transformed hair image ^ 
superimposed on said facial image within said display 
apparatus, wherein hair style simulation efficiency is 
enhanced. 

10. The image processing system of claim 9, wherein said 
first plurality of feature points further includes a second 3Q 
subset of feature points at locations at which said hair image 
is intended to overlap said facial image, said image process- 
ing system further comprising: 

means, responsive to an existence of a gap between said 
hair image and said facial image at locations at which 35 
said hair image is intended to overlap said facial image, 
for determining a third plurality of feature points within 
said facial perimeter and distributed along said facial 
perimeter, wherein each of said third plurality of fea- 
ture points corresponds to a respective one of said ^ 
second subset of said first plurality of feature points 
distributed along said interior perimeter of said hair 
image; 

means for constructing one or more secondary facial 
perimeter vectors by connecting neighboring feature 4S 
points among said third plurality of feature points 
distributed along said facial perimeter; 

means for constructing one or more secondary hair perim- 
eter vectors by connecting neighboring feature points 
within said second subset of said plurality of feature 50 
points distributed along said interior perimeter of said 
hair image; 

means for automatically transforming said hair image by 
displaying each of a plurality of pixels within said hair 
image at a transformed location, wherein a transformed ss 
location of each of said plurality of pixels within said 
hair image has a position with respect to said one or 
more secondary facial perimeter vectors determined 
from an original position of said pixel with respect to 
said one or more secondary hair perimeter vectors; and 60 

means, responsive to said transformation of said hair 
image, for displaying said transformed hair image 
superimposed on said facial image within said display 
apparatus. 

U. The image processing system of claim 10, wherein 65 
said means for determining a third plurality of feature points 
distributed along said facial perimeter comprises means for 



translating feature points within said second subset. from,, 
said hair image to said facial perimeter by reference to a 
reference point within said facial image. 

12. The image processing system of claim 9, and further 
comprising: 

means, following the construction of said one or more 
facial perimeter vectors, for determining whether a 
maximum distance in an orthogonal direction from a 
particular facial perimeter vector to a corresponding 
portion of said facial perimeter bounded by neighbor- 
ing feature points utilized to construct said particular 
facial perimeter vector exceeds a predetermined value; 

means, responsive to a determination that said maximum 
distance exceeds said predetermined value, for estab- 
lishing a new feature point on said facial perimeter 
between said neighboring feature points and a corre- 
sponding new feature point on said interior perimeter of 
said hair image. 

13. The image processing system of claim 9, wherein said 
means for transforming said hair image comprises: 

means for computing, for each of said plurality of pixels 
within said hair image, an intermediate transformed 
location with respect to each of said one or more hair 
perimeter vectors, wherein said intermediate trans- 
formed location has an identical position with respect 
to an associated facial perimeter vector as a position of 
a pixel of said hair image with respect to a hair 
perimeter vector corresponding to said associated facial 
perimeter vector, and 

means for computing from said one or more intermediate 
transformed locations a single transformed location for 
each of said plurality of pixels within said hair image, 
wherein each of said intermediate transformed loca- 
tions is assigned a weighting factor in said computa- 
tion. 

14. The image processing system of claim 13, wherein 
said weighting factor for each of said one or more interme- 
diate transformed locations depends upon a distance 
between said pixel of said hair image and said hair perimeter 
vector corresponding to said associated facial perimeter 
vector. 

15. The image processing system of claim 9, said facial 
image including two eyes, wherein said means for deter- 
mining a second plurality of feature points distributed along 
said facial perimeter comprises means for translating feature 
points within said subset from said hair image to said facial 
perimeter by reference to a reference line intersecting both 
eyes of said facial image. 

16. The image processing system of claim 9, and further 
comprising means for automatically correcting a size and 
orientation of said selected hair image with respect to said 
facial image. 

17. A computer program product within a computer 
readable media for causing an image processing system to 
simulate a selected hair style, said image processing system 
including a display apparatus and storage media for storing 
one or more hair images, said computer program product 
comprising: 

instruction means for causing said image processing sys- 
tem to provide a facial image, wherein said facial image 
includes a facial region bounded by a facial perimeter; 

instruction means for causing said image processing sys- 
tem to select one of said one or more hair images within 
said storage media to be simulated in association with 
said facial image, wherein said selected hair image 
includes an interior perimeter to be positioned adjacent 
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to said , facial image,, said interior perimeter of said 
selected hair image including a first plurality of feature 
points distributed along said interior perimeter of said 
hair image, wherein a subset of said first plurality of 
feature points are disposed at locations at which said 
hair image is intended to abut, but not substantially 
overlap said facial image; 

instruction means for causing said image processing sys- 
tem to determine a second plurality of feature points 
within said facial perimeter and distributed along said 
facial perimeter, wherein each of said second plurality 
of feature points corresponds to a respective one of said 
subset of said first plurality of feature points distributed 
along said interior perimeter of said hair image; 

instruction means for causing said image processing sys- 
tem to construct one or more facial perimeter vectors 
by connecting neighboring feature points among said 
second plurality of feature points distributed along said 
facial perimeter; 

instruction means for causing said image processing sys- 
tem to construct one or more hair perimeter vectors by 
connecting neighboring feature points within said sub- 
set of said first plurality of feature points distributed 
along said interior perimeter of said hair image; 

instruction means for causing said image processing sys- 
tem to automatically transform said hair image by 
displaying each of a plurality of pixels within said hair 
image at a transformed location, wherein a transformed 
location of each of said plurality of pixels within said 
hair image has a position with respect to said one or 
more facial perimeter vectors determined from an origi- 
nal position of said pixel with respect to said one or 
more hair perimeter vectors; and 

instruction means, responsive to said transformation of 
said hair image, for causing said image processing 
system to display said transformed hair image super- 
imposed on said facial image within said display 
apparatus, wherein hair style simulation efficiency is 
enhanced. 

18. The computer program product of claim 17, wherein 
said first plurality of feature points further includes a second 
subset of feature points at locations at which said hair image 
is intended to overlap said facial image, said computer 
program product further comprising: 

responsive to an existence of a gap between said hair 
image and said facial image at locations at which said 
hair image is intended to overlap said facial image, 
instruction means for causing said image processing sys- 
tem to determine a third plurality of feature points 
within said facial perimeter and distributed along said 
facial perimeter, wherein each of said third plurality of 
feature points corresponds to a respective one of said 
second subset of said first plurality of feature points 
distributed along said interior perimeter of said hair 
image; 

instruction means for causing said image processing sys- 
tem to construct one or more secondary facial perimeter 
vectors by connecting neighboring feature points 
among said third plurality of feature points distributed 
along said facial perimeter; 

instruction means for causing said image processing sys- 
tem to construct one or more secondary hair perimeter 
vectors by connecting neighboring feature points 
within said second subset of said plurality of feature 
points distributed along said interior perimeter of said 
hair image; 
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instruction means for causing said image processing sys- • 
tern to automatically transform said hair image by 
displaying each of a plurality of pixels within said hair 
image at a transformed location, wherein a transformed 
location of each of said plurality of pixels within said 
hair image has a position with respect to said one or 
more secondary facial perimeter vectors determined 
from an original position of said pixel with respect to 
said one or more secondary hair perimeter vectors; and 

instruction means, responsive to said transformation of 
said hair image, for causing said data processing sys- 
tem to displaying said transformed hair image super- 
imposed on said facial image within said display appa- 
ratus. 

19. The computer program product of claim 18, wherein 
said instruction means for causing said image processing 
system to determine a third plurality of feature points 
distributed along said facial perimeter comprises instruction 
means for causing said image processing system to translate 
feature points within said second subset from said hair 
image to said facial perimeter by reference to a reference 
point within said facial image. 

20. The computer program product of claim 17, and 
further comprising: 

instruction means for causing said image processing sys- 
tem to determine whether a maximum distance in an 
orthogonal direction from a particular facial perimeter 
vector to a corresponding portion of said facial perim- 
eter bounded by neighboring feature points utilized to 
construct said particular facial perimeter vector 
exceeds a predetermined value following construction 
of said one or more facial perimeter vectors; 

instruction means, responsive to a determination that said 
maximum distance exceeds said predetermined value, 
for causing said image processing system to establish a 
new feature point on said facial perimeter between said 
neighboring feature points and a corresponding new 
feature point on said interior perimeter of said hair 
image; and 

instruction means for causing said image processing sys- 
tem to repeat said steps of determining whether a 
distance exceeds a predetermined value and establish- 
ing a new feature point for each of said one or more 
facial perimeter vectors. 

21. The computer program product of claim 17, wherein 
said instruction means for causing said image processing 
system to transform said hair image comprises: 

instruction means for causing said image processing sys- 
tem to compute, for each of said plurality of pixels 
within said hair image, an intermediate transformed 
location with respect to each of said one or more hair 
perimeter vectors, wherein said intermediate trans- 
formed location has an identical position with respect 
to an associated facial perimeter vector as a position of 
a pixel of said hair image with respect to a hair 
perimeter vector corresponding to said associated facial 
perimeter vector, and 

instruction means for causing said image processing sys- 
tem to compute from said one or more intermediate 
transformed locations a single transformed location for 
each of said plurality of pixels within said hair image, 
wherein each of said intermediate transformed loca- 
tions is assigned a weighting factor in said computa- 
tion. 

22. The computer program product of claim 21, wherein 
said weighting factor for each of said one or more interme- 
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~t, diate transformed . locations - depends upon a distance . 
between said pixel of said hair image and said hair perimeter 
vector corresponding to said associated facial perimeter 
vector. 

23. The computer program product of claim 17, said facial 5 
image including two eyes, wherein said instruction means 
for causing said image processing system to determine a 
second plurality of feature points distributed along said 
facial perimeter comprises instruction means for causing 
said image processing system to translate feature points 
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•within said subset, from said hair image to said faciah 
perimeter by reference to a reference line intersecting both 
eyes of said facial image. 

24. The computer program product of claim 15, and 
further comprising instruction means for causing said image 
processing system to automatically correct a size and ori- 
entation of said selected hair image with respect to said 
facial image. 

* * * * * 
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it is certified that error appears in the above-identified patent and that said Letters Patent is 
hereby corrected as shown below: 



Column 2, 

Lines 3 through 5, please delete and replace with - It is yet another object of the present 
invention to provide an easily operable hair style simulation system which automatically 
fits an image of a hair style to a facial image. - 

Column 10. 

Line 51, please delete "said;" and replace with -- said --. 
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Third Day of June, 2003 




JAMES E. ROGAN 
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